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Abstract. Let f^(k) be the number of 132-avoiding permutations on n letters that 
contain exactly r occurrences of 12 ... k, and let F r (x; k) and F(x, y- k) be the generat- 
ing functions defined by F r (x; k) = Y^n^o fn( k ) xn and F ( x , 2/5 fc ) = Z) r >0 F r( x > k)y r . 
We find an explicit expression for F(x, y; k) in the form of a continued fraction. This 
allows us to express F r (x; k) for 1 r ^ k via Chebyshev polynomials of the second 
kind. 
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1. Introduction 

Let [p] = {1, . . . ,p} denote a totally ordered alphabet on p letters, and let a = 
(cki, . . . , ct m ) G [pi] m , (3 = (Pi, . . . , (3rn) G [P2] m - We say that a is order-is omorphic 
to /3 if for all 1 ^ i < j ^ m one has «i < «j if and only if f3i < f3j. For 
two permutations it G & n and r G an occurrence of r in 7r is a subsequence 
1 ^ i\ < %2 < • • • < ik ^ n such that (tt^, . . . , ir ik ) is order-isomorphic to r; in such 
a context r is usually called the pattern. We say that n avoids r, or is r-avoiding, if 
there is no occurrence of r in n. The set of all r-avoiding permutations of all possible 
sizes including the empty permutation is denoted ©(r). Pattern avoidance proved 
to be a useful language in a variety of seemingly unrelated problems, from stack 
sorting [5] to singularities of Schubert varieties [6]. A complete study of pattern 
avoidance for the case r G ©3 is carried out in [11]. For the case r G 64 see [14, 
11,12,1]. 

A natural generalization of pattern avoidance is the restricted pattern inclusion, 
when a prescribed number of occurrences of r in n is required. Papers [8] and [3] 
contain simple expressions for the number of permutations containing exactly one 
123 and 132 patterns, respectively. The main result of [B2] is that the generating 
function for the number of permutations containing exactly r 132 patterns is a 
rational function in variables x and \/l — Ax. This proves a particular case of the 
general conjecture of Noonan and Zeilberger [9] which is that for any set T of 
patterns, the sequence of numbers enumerating permutations having a prescribed 
number of occurrences of patterns in T is P-recursive. Recent paper [10] presents 
the generating function for the number of 132-avoiding permutations that contain 
a prescribed number of 123 patterns. The generating function is given in the form 
of a continued fraction. In the present note we generalize the argument of [10] 
to get the generating function for the number of 132-avoiding permutations that 
contain a prescribed number of 12 ... k patterns for arbitrary k ^ 3. The study of 
the obtained continued fraction allows us to recover and to generalize the result of 
[4] that relates the number of 132-avoiding permutations that contain no 12 ... k 
patterns to Chebyshev polynomials of the second kind. 

The authors are grateful to C. Krattenthaler, H. Wilf, and anonymous referee 
for useful comments concerning Theorems 4.1 and 4.2. 

2. Continued fractions 

Let fn(k) stand for the number of 132-avoiding permutations on n letters that 
contain exactly r occurrences of 12 ... k. We denote by F(x, y; k) the generating 
function of the sequence {/^(/c}), that is, 

F(x,y;k) = Y / Y,fn(k)x n y r . 
Our first result is a natural generalization of the main theorem of [10]. 
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Theorem 2.1. The generating function F(x,y;k) for k ^ 1 is given by the con- 
tinued fraction 



F(x 7 y;k) = 1 - 

xy 1 



xy d2 



1 _ V 3 



where di = ariC ^ (5) assumed whenever a < b or b < 0. 

Proof. Following [10] we define Tfj(ir), 3 ^ 1, as the number of occurrences of 12 . . . j 
in 7r. Define ?7o(7r) = 1 for any 7r, which means that the empty pattern occurs 
exactly once in each permutation. The weight of a permutation tv is a monomial in 
independent variables 51 , . . . , defined by 

= IK' 00 . 

The £o£aZ weight is a polynomial 

Wfc(gi,...,g fc ) = «^(»- 

tt6S(132) 

The following proposition is implied immediately by the definitions. 

Proposition 2.1. F(x,y;k) = Wk(x, 1, . . . , 1, y) for k ^ 2, and F(x,y;l) = 
W 1 (xy). 

We now find a recurrence relation for the numbers rjj^ir). Let n G <5 n , so that 
tv = (tt' , n, it"). 

Proposition 2.2. For any j ^ 1 and any nonempty n G 6(132) 

Proof. Let / = 7r _1 (n). Since 7r avoids 132, each number in 7r' is greater than any 
of the numbers in n" . Therefore, tt' is a 132-avoiding permutation of the numbers 
{n — l + l, n — 1 + 2, . . . , n — 1}, while tv" is a 132-avoiding permutation of the numbers 
{1, 2, ... ,n — I}. On the other hand, if tv' is an arbitrary 132-avoiding permutation 
of the numbers {n — I + 1, n — I + 2, . . . , n — 1} and 7r" is an arbitrary 132-avoiding 
permutation of the numbers {1, 2, . . . , n — /}, then tv = (tt', n, tv") is 132-avoiding. 
Finally, if . . . ,ij) is an occurrence of 12 . . .j in tv then either ij < /, and so it 
is also an occurrence of 12 . . .j in tt', or i\ > /, and so it is also an occurrence of 
12 . . . j in tt" , or ij = /, and so . . . , ij-i) is an occurrence of 12 . . .j — 1 in tv' . 
The result follows. □ 
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Now we are able to find the recurrence relation for the total weight W. Indeed, 
by Proposition 2.2, 

W k (q u • • .,?*) = 1 + £ II q^'W^- 1 ^ 

0^7r6e(132) 3 = 1 

=i+ e e n^ ( "" , -«nfe» + i)" ( '' ) -^ ( ''' ) 

7r'6e(132) 7r"6e(132) j = l j=l 

= 1 + giWfc(gi, • • • , 9fc)Wfc(9i92, ?2<?3, • • • , Qk-iQk, (1) 



For any <i ^ and 1 ^ m ^ define 

fc 



(■* ) 

\]—m) . 



q d,m = n % 

3 = 1 

recall that = 0ifa<6or6<0. The following proposition is implied immedi- 
ately by the well-known properties of binomial coefficients. 

Proposition 2.3. For any d ^ and 1 ^ m ^ k 

d,m d,m+l d+l,m 

Observe now that Wk(qi, ■ ■ ■ , qk) = Wk(<l 0,1 , . . . , q°' fc ) and that by (1) and 
Proposition 2.3 

W k (q d '\ . . . , q d > fc ) = 1 + q^WfcCq* 1 , . . . , q d ' fc )W fc (q d+1 > 1 , . . . , q d+1 ' fc ), 
therefore ( 

Wfc(gi,--.,gjfc) = ■ 



To obtain the continued fraction representation for F(x, y; k) it is enough to use 
Proposition 2.1 and to observe that 



q d,i 



<?i=a;,g2=---=gfe-i=l,gfc=y 



U-i). □ 



Remark. For k = 1 one recovers from Theorem 2.1 the well-known generating 
function for the Catalan numbers, (1 — y/1 — Az)/2z. This result also follows im- 
mediately from Proposition 2.1 and equation (1), which for k = 1 is reduced to 
W 1 (q) = l + qW?(q). 



PERMUTATIONS, FRACTIONS, AND CHEBYSHEV POLYNOMIALS 5 



3. CHEBYSHEV POLYNOMIALS 

Let us denote by F r (x; k) the generating function of the sequence for a 

given r, that is, 

F r (x;k) = J2fn(k)c 

n>0 



)x n . 



Recall that F(x, y; k) = J2 r ^o ^r(x; k)y r . In this section we find explicit expressions 
for F r (x; k) in the case ^ r ^ k. 
Consider a recurrence relation 

Tj = , j > 1. (2) 

The solution of (2) with the initial condition To = is denoted by Rj(x), and the 
solution of (2) with the initial condition 

T = G(x,y;k) = V 



xy\ 2 > 



(k+2\ 

_ xyy 3 > 



is denoted by Sj (x, y; k) , or just Sj when the value of k is clear from the context. Our 
interest in (2) is stipulated by the following relation, which is an easy consequence 
of Theorem 2.1: 

F(x,y;k) = S k (x,y;k). (3) 

First of all, we find an explicit formula for the functions Rj(x). Let Uj(cos6) = 
sin(j + 1)0/ sin6> be the Chebyshev polynomials of the second kind. 

Lemma 3.1. For any j ^ 1 

Rj {x) = (4) 

v^i (275) 

Proof. Indeed, it follows immediately from (2) that Rj(x) is the jth approximant 
for the continued fraction 

1 
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Hence, by [7, Theorem 2, p. 194], for any j ^ 1 one has Rj(x) = Aj(x)/Aj +1 (x), 
where 

, , , fl + VT^4x~\ J fl - VI -4x x 3 

Using substitution x -> l/At 2 one gets {2t) j A 3 (l/4t 2 ) = 2Vt 2 - lt/,-_i(t), which 
gives Aj(x) = \J\jx — 4a; J '/ 2 t/"j_i(l/2y / a : ), and the result follows. □ 

Next, we find an explicit expression for Sj in terms of G and Rj. 

Lemma 3.2. For any j ^ 1 and any k ^ 1 

bj(x,y: k) = RAx) . . —7 — — . 5 

JV ' y ' y JV ; 1 -xR j (x)G(x,y;k) v ; 

Proof. Indeed, from (2) and So = G we get Si = 1/(1 — xG). On the other hand, 
Rq = 0, i?i = 1, so (5) holds for j = 1. Now let j > 1, then by induction 

s _ 1 1 l-xi^G 



J 1 - xSj-i 1 - xRj-i x(l - xRj- 2 )Rj-iG ' 

1 — xRj-i 

Relation (2) for Rj and Rj-i yields (1 — xRj-2)Rj-i = (1 — xRj-i)Rj = 1, which 
together with the above formula gives (5). □ 

As a corollary from Lemma 3.2 and (3) we get the following expression for the 
generating function F(x,y;k). 

Corollary. 

F(x, y; k) = R k (x) + (R k (x) - R k -i(x)) (xR k (x)G(x, y; k)) m . 

Now we are ready to express the generating functions F r (x; k), ^ r ^ k, via 
Chebyshev polynomials. 

Theorem 3.1. For any k ^ 1, F r (x;k) is a rational function given by 
F r (x;k) = fc ~ 1 ; l<r<fc, 
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where Uj is the jth Chebyshev polynomial of the second kind. 

Proof. Observe that G(x, y; k) = y + y k+1 P(x, y), so from Corollary we get 

k 

F(x,y;k) = R k (x) + (R k (x) - R k -i(x)) E (xR k (x)) m y m + y k+1 P'(x, y), 

m=l 

where P(x, y) and P'(x, y) are formal power series. To complete the proof, it suffices 
to use (4) together with the identity U^_ l (z) — U n (z)U n -2(z) = f, which follows 
easily from the trigonometric identity sin 2 n9 — sin 2 9 = sin(n + 1)0 sin(n — 1)9. □ 

For the case r = this result was proved by a different method in [4]. 

4. Further results 

There are several ways to generalize the results of the previous sections. First, 
one can try to get exact formulas for F r (x;k) in the case r > k. The method 
described in Section 3 allows, in principle, to obtain such formulas, though they 
become more and more complicated. For example, the following theorem gives an 
explicit expression for F r (x; k) when r ^ k(k + 3)/2. 

Theorem 4.1. For any k ^ 1 and 1 ^ r ^ k(k + 3)/2, F r (x;k) is a rational 
function given by 

where Uj is the jth Chebyshev polynomial of the second kind. 
Proof. Indeed, the explicit expression for G(x,y; k) gives 

G(x, y; k)=y(l + xy k + --- + x s y ks ) + y l P{x, y), 

where s = \(k + l)/2] , t = 1 + k(k + 3)/2, and P(x,y) is a formal power series. 
Hence, by Corollary, 

F ^y-; k) ' R f] = E (^Mx)) m y m (i + xy k + --- + x s y ks T + Sp'^, y) 

K k {X) — K k -i(X) 



E (xR k (x)r y m f^( m + j 1 )x>y k i + y t P'{x,v) 



m>l j=0 

L(r-l)/fcJ (r-kj+j-l^ x j 

r>\ i^o (xR k (x)) 



J2y r (xRk(x)) r E ~ J, J kj +v t P"(*>v)> 
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where P'(x,y) and P"(x,y) are formal power series. The rest of the proof follows 
the proof of Theorem 3.1. □ 

Another possibility is to analyze the case of permutations containing exactly 
one 132 pattern and r 12 ... k patterns. Introducing the modified total weight 
. . . , q k ) as the sum of the weights Wk(7t~) over all permutations containing 
exactly one 132 pattern, we get the following equation: 

fifc(9i, • • • , Qk) = qiW k {qiq2, • • • , qk-lQk, Qk)^k{qi, ■ ■ ■ , qk) 
+ qiW k (qi, ••• , qk)^k(qiQ2, • • • , qk-iQk, Qk) 
+ qlqlW k (qiq 2 , • • • , qk-iqk, qk) (W k (qi, ...,%)- l); 

for the case k = 3 see [10]. By (1) and Proposition 2.3 this is equivalent to 



ft fe (q d >\ . . . , q d ' fc ) = q^ 1 (q d < 2 ) 2 (W k (^\ . . . , q d > fc ) - l) 2 

+ q d,1 W^(q d>1 , . . . , q d ' fc )f2fc(q d+1>1 , . . . , q d+1 ' fc ). 



(6) 



Let now <p^(fc) be the number of permutations on n letters that contain exactly 
one 132 pattern and r 12... k patterns, and 3> r (x;k) be the generating function 
of the sequence {y^(&)} f° r a given r. In general, equation (6) allows us to find 
explicit expressions for 3> r (x;k). However, they are rather cumbersome, so we 
restrict ourselves to the case r = 0. 

Theorem 4.2. For any k ^ 3, <&o(x;k) is a rational function given by 

k-2 



u k {2^) 3=1 



n , , t 2 sin(2fc-l)* 
2k - 5 + 4 cos 2 t - 



16sm 2 (k + l)tcos 2 t \ sint 
where Uj is the jth Chebyshev polynomial of the second kind and cost = l/2y/x. 
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